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ON  IMPROVING  THE  FLIGHT  FIDELITY 
OF  OPERATIONAL  FLIGHT/WEAPON  SYSTEM  TRAINERS 

Mr.  R.  Thomas  Galloway 
Aerospace  Engineer 
Special  Projects  Branch 
Strike  Aircraft  Test  Directorate 
Naval  Air  Test  Center 
Patuxent  River,  Md.  20670 
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SUMMARY 

A team  approach  utilizing  the  complementary  talents  and  expertise 
of  Naval  test  pilots,  flight  test  engineers,  computer  specialists,  and 
simulator  specialists  from  various  Naval  field  activities  has  been  ef- 
fective in  improving  the  flight  fidelity  of  existing  Operational  Flight 
Trainers  and  Weapon  System  Trainers  and  in  guiding  contractors  in  pro- 
viding the  best  fidelity  possible  in  new  flight  simulators.  The  paper 
discusses  this  team  approach  and  presents  the  results  obtained  in  several 
programs . 

The  team  uses  conventional  flight  test  techniques  to  quantify  the 
parameters  necessary  to  describe  the  flying  qualities  and  performance  of 
the  simulator  and  the  airplane.  From  this  comparative  data  the  flight 
fidelity  deficiencies  of  the  simulator  are  quantitatively  Identified. 

The  software  of  the  simulator  (and  in  rare  Instances  the  hardware)  is 
then  modified  by  an  iterative  process  until  the  flying  qualities  of 
the  simulator  match  those  of  the  airplane.  The  paper  discusses  this  pro- 
cess of  matching  flying  qualities  by  conventional  flight  test  techniques 
in  detail. 

In  addition,  recent  advances  in  the  field  of  parameter  identifica- 
tion are  discussed  as  applied  to  the  extraction  of  stability  derivatives 
from  flight  test  data.  An  advanced  state-of-the-art  maximum  likelihood 
estimation  algorithm  is  now  operational  at  the  Naval  Air  Test  Center. 

This  algorithm  can  and  is  being  used  in  several  active  programs  to  pro- 
vide an  accurate  flying  qualities  and  performance  data  base  for  a given 
airplane. 


CDR  Marie  D.  Hewett  USN 
Special  Projects  Officer 
Strike  Aircraft  Test  Directorate 
Naval  Air  Test  Center 
Patuxent  River,  Md.  20670 
USA 
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SYMBOLS 

S 

drag  coefficient 

Subscripts 

Cl 

lift  coefficient 

n natural 

pitching  moment  coefficient 

d damped 

• Si 

yawing  moment  coefficient 

Cl 

rolling  moment  coefficient 

^(x) 

pitching  moment  derivative 

"^(x) 

yawing  moment  derivative 

^l(x) 

rolling  moment  derivative 

^Y(x) 

side  force  derivative 

p 

roll  rate 

q 

pitch  rate 

r 

yaw  rate 

«a 

lateral  control  deflection 

longitudinal  control  deflection 

«r 

directional  control  deflection 

normal  acceleration 

S 

wing  area 

u 

true  airspeed 

W 

gross  weight 

k 

a constant 

a 

angle  of  attack 

6 

sideslip 

6 

control  deflection 

C 

damping  ratio 

P 

air  density 

0) 

frequency 
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INTRODUCTION 

The  U.  S.  Navy  uses  Operational  Flight  Trainers  (OFT)  and  Weapon 
System  Trainers  (WST)  to  train  pilots  in  today's  complicated  and 
expensive  aircraft  weapon  systems.  Over  the  years  these  devices  have 
acquired  a dismal  reputation  for  faithful  simulation  of  a given  airplane's 
flying  qualities.  As  a result  the  training  value  of  these  simulators 
has  been  less  than  optimal.  In  many  cases  this  lack  of  faithful 
flying  qualities  simulation  has  reduced  the  role  of  these  expensive 
devices  to  that  of  procedures  trainers  for  Instrument  flight  and 
emergency  conditions  vice  that  for  which  they  were  ueslgned:  complete 
operational  flight  and  weapon  system  training. 

This  degraded  training  value  could  be  tolerated  by  the  Navy  as 
long  as  enough  airplanes,  fuel,  and  money  were  available  to  train  and 
maintain  proficiency  with  actual  flight  time.  However,  the  energy 
crisis.  Increased  aircraft  operating  costs,  and  austere  budgeting  have 
made  actual  flight  time  an  expensive  commodity.  Because  of  these 
factors  Increased  emphasis  has  been  placed  on  the  use  of  simulators 
for  training  and  proficiency.  In  fact,  the  Chief  of  Naval  Operations 
has  issued  instructions  (reference  (1))  that  Naval  Aviators  participating 
in  the  Proficiency  Flying  Program  may  substitute  10%  (10  hours)  of 
their  total  annual  minimum  flight  time  requirement  with  12  hours  or 
more  of  simulator  time  on  a certified  OFT  or  WST.  The  instruction 
further  states  that  "as  additional  simulators  become  available  and 
more  is  learned  on  the  'transfer  of  learning'  gained  through  the  use 
of  simulation,  the  program  will  be  expanded."  With  this  ever  increasing 
emphasis  on  the  use  of  simulators  for  training  and  proficiency  and  the 
growing  need  to  actually  substitute  simulator  time  for  flight  time,  we 
have  found  it  absolutely  necessary  to  bring  our  full  technical  resources 
to  bear  on  the  problem  of  providing  the  best  flight  simulation  possible 
within  given  cost  constraints. 

Another  factor  which  has  highlighted  the  need  for  faithful  flying 
qualities  simulation  in  Operational  Flight  and  Weapons  System  Trainers 
is  the  addition  of  visual  display  systems.  Carrier  and  field  landings, 
aerobatics,  weapons  delivery,  and  a multitude  of  other  mission  related 
tasks  can  now  be  simulated  with  visual  systems.  The  addition  of  such 
systems,  however,  tends  to  magnify  the  flying  qualities  and  perfor- 
mance discrepancies  of  the  basic  simulator.  Recently,  a visual  display 
system  was  added  to  one  cockpit  of  a 2F90  Device  at  the  Naval  Air 
Station,  Kingsville,  Texas.  It  was  quickly  found  that  simulated 
carrier  and  field  landings  and  bombing  runs  with  the  visual  display 
had  relatively  little  training  value  for  student  pilots  because  the 
simulation  of  the  real  TA-4J  airplane  flying  qualities  was  so  poor. 
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Generally,  Operational  Flight  and  Weapons  Systan  Trainers  are 
capable  of  providing  excellent  flying  qualities  and  performance  simu- 
lation of  the  real  airplane.  Although  hardware  limitations  are  always 
a factor,  it  is  poor  software  programming  that  is  responsible  for  most 
of  the  degradation  in  flying  qualities  simulation  of  the  typical 
trainer.  Aircraft  manufacturers  generally  rely  on  the  wind  tunnel 
data  as  a data  base.  Flight  test  data  are  not  available  because  the 
first  training  device  is  usually  delivered  to  the  Fleet  at  about  the 
same  time  that  the  first  airplane  comes  off  the  production  line. 

Since  wind  tunnel  data  represent  at  best  only  an  estimate  of  airplane 
flight  characteristics,  the  use  o^  these  data  as  a data  base  for  a simu- 
lator results  in  poor  flying  qualities  simulation.  In  addition,  there 
has  been  no  organized  effort  within  the  Navy  or  by  any  manufacturer  to 
reprogram  a simulator  once  flight  test  data  are  available.  The  2F90 
Device  is  typical.  Although  this  device  has  been  around  for  years  and 
TA-4J  airplanes  have  acquired  thousands  of  flight  hours,  the  device 
until  very  recently  still  used  wind  tunnel  data  as  a data  base. 

Furthermore,  simulator  manufacturers  have  been  ineffective  in 
transforming  fleet  user  flying  qualities  complaints  into  viable  fixes 
for  fidelity  improvements.  Fleet  pilots,  used  exclusively  in  the  past 
for  fleet  acceptance  of  a new  simulator,  are  capable  of  recognizing  a 
flying  qualities  discrepancy,  but  they  are  simply  not  trained  to 
describe  an  aerodynamic  phenomenon  in  engineering  terms.  The  communica- 
tions gap  between  the  fleet  pilot  and  the  simulator  specialist  is 
difficult  to  overcome. 

Recently,  the  Naval  Air  Test  Center  (NATC)  has  become  involved  in 
an  effort  to  improve  the  flight  fidelity  of  existing  Operational 
Flight  and  Weapons  Systan  Trainers  and  in  evaluating  and  improving  the 
flight  fidelity  of  new  trainers.  Results  indicate  that  NATC  has  been 
effective  in  bridging  the  communications  gap  between  the  fleet  pilots 
(user)  and  the  simulator  specialist.  Conventional  flight  test  techniques 
are  used  in  the  simulator  and  in  the  airplane  to  identify  and  quantify 
the  flying  qualities  deficiencies  of  the  simulator.  The  test  techniques 
used  are  standard  flying  qualities  and  performance  tests  (references 
(2)  and  (3))  designed  to  isolate  the  effects  of  specific  stability 
derivatives  and  performance  parameters  which  provide  the  data  base  for 
the  simulator.  The  data  base  is  then  modified  as  required  and  the 
tests  repeated  in  the  simulator  and  the  airplane  until  a match  is 
obtained . 

A team  approach  to  the  problem  has  made  this  process  possible. 

The  necessary  team  members  are  fleet  experienced  pilots  intimately 
familiar  with  the  airplane  being  simulated,  test  pilots  trained  in 
flying  qualities  and  performance  testing,  flight  test  engineers  experienced 
in  both  flight  test  techniques  and  simulators,  and  simulator  and 
computer  experts  with  an  intimate  knowledge  of  simulators  in  general 
and  the  simulator  under  test  in  specific.  Such  teams  composed  of 
personnel  from  the  Naval  Air  Test  Center,  the  Naval  Training  Equipment 
Center,  the  Naval  Education  and  Training  Program  Development  Center  and 
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the  Naval  Air  Training  Conmand  have  been  successful  in  significantly  im- 
proving the  flight  fidelity  of  the  2F90  Device  which  simulates  the  TA-4J 
airplane  and  the  new  2F101  Device  which  simulates  the  T-2  airplane  both 
used  by  the  Naval  Air  Training  Command. 

Recent  advances  in  the  field  of  parameter  identification  as  applied 
to  flight  test  have  significantly  improved  the  process  of  extracting 
stability  derivatives  from  flight  time  history  responses  to  certain 
control  inputs.  The  identification  algorithm  used  at  the  Naval  Air  Test 
Center  is  based  on  a maximum  likelihood  estimation  scheme  which  Includes 
a rank  deficient  solution,  and  the  capacity  to  handle  both  instrumentation 
and  process  noise.  The  algorithm  has  direct  application  to  simulation 
flight  fidelity  because  a far  more  accurate  and  complete  data  base  can 
be  provided  from  flight  test  data  than  was  ever  possible  in  the  past. 

The  process  is  expected  to  have  a significant  impact  on  simulator  soft- 
ware programming. 

This  paper  describes  the  ongoing  programs  at  the  Naval  Air  Test 
Center  to  improve  the  flight  fidelity  of  operational  flight  trainers 
using  both  conventional  flight  tests  and  advanced  systems  identification 
techniques.  Conventional  test  techniques  will  be  described  as  to  the 
exact  flight  tests  used,  their  order  of  application  and  the  iterative 
process  of  optimizing  the  software  package  of  a given  simulator  for  good 
flight  fidelity.  The  parameter  identification  program  will  be  discussed 
and  results  obtained  from  flight  tests  will  be  presented.  The  appli- 
cation and  extrapolation  of  parameter  identification  techniques  to  im- 
prove simulator  flight  fidelity  will  be  outlined. 

CONVENTIONAL  TEST  METHODS 

General 

The  conventional  flight  test  techniques  used  to  Identify  and  quan- 
tify the  flight  fidelity  discrepancies  of  a given  OFT  or  WST  are  described 
in  this  section.  These  conventional  test  methods  are  the  standard 
performance,  stability,  and  control  flight  tests  methods  used  to  test 
new  aircraft  for  flying  qualities  and  performance  specification  compliance. 
They  are  described  in  detail  in  references  (2)  and  (3).  It  is  possible 
with  these  methods  to  Isolate  the  effects  of  a number  of  the  stability 
derivatives  and  coefficients  required  to  complete  the  mathematical 
model  used  in  the  simulator  software  to  model  the  motion  of  the  simu- 
lated airplane.  The  effects  of  many  other  important  coefficients  and 
derivatives  on  the  response  of  the  simulation  to  control  inputs  cannot 
be  isolated  by  a specific  test.  In  most  of  these  cases,  however,  an 
iterative  technique  can  be  devised  consisting  of  a series  of  tests 
performed  in  a specific  order  to  determine  the  individual  contribution 
of  each  parameter  to  the  response  of  the  simulator.  In  this  technique 
the  concept  is  not  to  calculate  specific  values  of  each  derivative  or 
parameter  but  rather  to  use  an  Identical  series  of  tests  in  the  simulator 
and  airplane  to  match  the  output  or  response  of  the  simulator  to  control 
Inputs  by  adjusting  these  parameters.  This  technique  is  Iterative  in 
all  cases  except  those  in  which  certain  tests  can  be  used  to  isolate 
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specific  parameters.  The  iterative  technique  amounts  to  an  output  error 
method  In  terms  of  mathematical  optimization  theory.  Of  course,  as  in 
any  optimization  technique  an  initial  guess  of  all  parameters  must  be 
made  at  each  flight  condition  to  start  the  iterative  procedure.  We 
simply  use  those  values  present  in  the  simulation  at  the  beginning  of 
the  flight  fidelity  improvement  program. 

There  are  two  basic  categories  of  tests  to  be  performed  in  both 
simulator  and  airplane.  First,  performance  tests  are  conducted  to 
quantify  aircraft  and  simulator  thrust  and  drag  characteristics.  The 
idea  in  performance  testing  is  to  determine  the  various  coefficients  in 
the  lift  and  drag  equations  of  motion.  That  is,  we  must  determine  lift 
and  drag  coefficients  as  functions  of  Mach  number  and  angle  of  attack, 
contributions  to  drag  and  lift  of  all  functional  devices  such  as  landing 
gear,  speed  brakes,  flaps,  etc.,  engine  thrust  characteristics,  and  so 
on.  The  second  basic  category  is  stability  and  control  testing.  The 
purpose  of  stability  and  control  testing  is  to  determine  the  various 
coefficients  and  parameters  in  the  three  moment  equations  of  motion; 
roll,  pitch  and  yaw. 

Performance  Tests 

The  performance  tests  used  to  quantify  thrust  and  drag  characteris- 
tics are  shown  in  table  I,  items  3,  4 and  6,  The  proper  order  of  tests 
is  also  Indicated.  The  test  methods  used  in  performance  work  are  described 
in  detail  in  reference  (2). 

Steady  state  trim  points  are  obtained  throughout  the  flight  envelope 
for  speed/power  relationships.  At  each  stabilized  trim  point  we  record 
airspeed,  altitude,  engine  parameters,  angle  of  attack,  power  lever 
angle,  aircraft  attitude  and  gross  weight.  Since  installed  engine 
thrust  is  generally  known  as  a function  of  airspeed  and  altitude,  these 
steady  state  trim  points  can  be  used  to  establish  or  to  verify  drag 
polar  information  (basic  drag  and  lift  coefficients  (Cl  and  Cp)  as  a 
function  of  Mach  number  and  angle  of  attack)  in  the  simulator  software. 
Repeating  the  trim  points  in  all  aerodynamic  configurations  such  as 
landing  gear  down,  flaps  down,  speed  brakes  deployed,  etc.,  it  is  pos- 
sible to  determine  the  contributions  to  lift  and  drag  of  each  device. 

Timed  level  accelerations,  level  decelerations,  and  timed  climbs 
and  descents  can  then  be  used  to  further  refine  and  verify  thrust,  lift, 
and  drag  relationships. 

Another  Important  area  in  performance  not  listed  in  table  I is 
engine  acceleration  and  deceleration  characteristics.  Timed  engine 
response  is  obtained  and  matched  by  altering  the  engine  model  if  neces- 
sary. 

Of  course,  all  of  these  performance  tests  are  performed  throughout 
the  flight  envelope  in  both  simulator  and  airplane  in  all  configurations. 
The  process  of  incorporating  software  fixes  as  a result  of  these  tests 
in  the  lift  and  drag  equations  of  motion  is  iterative  since  certain 
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terms  interact.  For  example,  a change  to  the  basic  lift  coefficient 
affects  the  drag  coefficient  through  the  drag  polar. 

An  Interesting  performance  fidelity  problem  arose  in  the  2F90  program 
which  illustrates  the  degree  of  sophistication  required  of  the  mathemati- 
cal model  to  accurately  simulate  aircraft  performance  characteristics 
and  the  difficulties  encountered  in  translating  a fidelity  discrepancy 
to  a software  program  fix.  Pilots  complained  that  simulator  response  to 
throttle  changes  in  the  power  approach  configuration,  in  particular,  was 
not  realistic.  The  simulated  airplane  tended  to  float  as  power  was 
reduced  and  was  not  as  responsive  as  the  airplane  to  power  addition. 

Engine  and  thrust  acceleration  and  deceleration  data  failed  to  show  a 
discrepancy  between  simulator  and  airplane.  Steady  state  thrust  and 
drag  relationships  obtained  from  trim  points  in  the  power  approach 
configuration  had  already  been  corrected  and  matched  well.  The  problem 
was  with  aircraft  transient  response  to  throttle  changes.  After  much 
investigation,  it  was  discovered  that  ram  drag  was  not  incorporated  as  a 
separate  term  in  the  drag  equation.  Ram  drag  has  a substantial  effect 
on  aircraft  transient  response  to  power  changes  due  to  the  increase  in 
ram  drag  during  engine  decelerations  from  intake  air  spillage  and  vice 
versa.  The  incorporation  of  this  term  tailored  by  qualitative  pilot 
opinion  solved  the  aircraft  response  problem  in  the  power  approach 
conf Igur a t ion . 

Stability  and  Control  Tests 

For  flying  qualities  or  stability  and  control  work,  the  testing  is 
divided  into  two  categories;  longitudinal  flying  qualities  and  lateral- 
directional  flying  qualities.  This  is,  of  course,  a natural  break  since 
the  linearized  pitching  moment  equation  is  decoupled  from  the  yawing  and 
rolling  moment  equations.  Stability  and  control  test  methods  are  dis- 
cussed in  reference  (3). 

First,  longitudinal  flying  qualities  test  methods  will  be  considered. 
The  tests  used  to  Isolate  longitudinal  flying  qualities  fidelity  defi- 
ciencies are  given  in  table  I along  with  the  previously  discussed  per- 
formance tests.  The  first  step  is  to  perform  static  tests  on  the  mechani- 
cal characteristics  of  the  longitudinal  control  system.  This  is  the 
starting  point  for  flying  qualities  testing.  Breakout  forces,  dead- 
bands, static  force  versus  deflection,  full  throw  forces  and  deflections, 
control  centering  characteristics,  friction  levels,  freeplay,  viscous 
effects,  trim  rates,  and  so  forth,  are  measured  and  matched  between 
simulator  and  airplane. 

In  the  2F90  and  2F101  fidelity  improvement  programs  a hardware  change 
was  made  in  the  area  of  mechanical  characteristics  of  the  longitudinal 
and  lateral-directional  control  systems.  Diodes  were  added  in  the  analog 
force  circuitry  to  simulate  breakout  forces.  In  the  2F90  Deivce,  germanium 
diodes  with  cut-in  voltages  of  approximately  0.1  volts  were  suitable  for 
longitudinal  and  lateral  control  system  breakout  simulation  whereas  sili- 
con diodes  with  a cut-in  voltage  of  0.7  volts  were  more  suitable  for  direc- 
tional control  system  breakout.  In  figure  1 the  effect  of  the  addition 
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of  breakout  diodes  is  shown  in  the  longitudinal  control  system  of  the 
2F90  Device. 

On  the  2F90  and  2F101  fidelity  improvement  programs  hand  held 
instrumentation  and  pilot  recorded  data  was  used  for  flying  qualities 
testing  and  found  to  be  adequate.  Force  gages,  a three  second  stop 
watch,  tape  measures  and  the  like  typified  the  instrumentation  used.  On 
a new  airplane  and  simulator  an  Instrumented  airplane  is  available  for 
flying  qualities  and  performance  work  and  would  be  used  to  gather  flight 
data  for  the  simulator. 

Having  matched  the  static  control  system  mechanical  characteristics, 
we  now  turn  to  "in  flight"  tests.  The  pitching  moment  contribution  of 
various  aerodynamic  devices  such  as  flaps,  landing  gear,  speed  brakes, 
etc.  can  be  determined  by  performing  longitudinal  open  loop  trim  changes. 
After  stabilizing  the  airplane  or  simula'tor  at  a given  trim  point  in  the 
flight  envelope,  a time  history  of  the  open  loop  pitch  angle  change  from 
trim  is  recorded  with  actuation  or  deactuation  of  the  various  devices. 

A match  is  obtained  between  simulator  and  airplane  by  adjusting  the 
pitching  moment  coefficient  of  the  device  in  question  until  acceptable 
time  history  matches  are  obtained. 

The  next  test  is  designed  to  Isolate  the  effects  of  the  important 
stability  derivative  the  rate  of  change  of  pitching  moment  with 

angle  of  attack.  From  theoretical  analysis  (reference  (3))  it  can  be 
shown  that 

‘hb  =■  ->“n^ 

where  is  the  longitudinal  short  period  natural  frequency.  This  is  a 
very  approximate  relation  but  is  sufficient  as  a starting  point.  Short 
period  natural  frequency  can  be  estimated  at  a given  flight  condition  by 
observing  the  open  loop  pitch  response  to  a pitch  doublet  designed  to 
excite  the  short  period  mode  of  motion  or  by  a frequency  response  test 
such  as  observing  the  pitch  response  of  the  airplane  to  sinusoidal 
control  pumps  of  varying  frequency.  The  derivative  is  considered 
correct  in  the  simulator  software  if  airplane  and  simulator  short  period 
responses  match  when  using  the  same  type  input  in  each  vehicle. 

The  next  test  yields  indications  of  the  longitudinal  static  stabi- 
lity of  the  airplane  and  simulator,  and  is  used  to  determine  longitudinal 
control  position  and  force  from  trim  versus  airspeed  about  a trim  point. 
The  test  method  is  described  in  reference  (3).  Figure  2 shows  an  example 
from  the  2F90  program.  The  trim  points  are  as  shown.  The  circles  repre- 
sent airplane  data.  The  shaded  triangles  represent  the  2F90  OFT  before 
modification.  The  open  triangles  represent  the  2F90  after  modification. 
From  theoretical  analysis  it  can  be  shown  (reference  (3))  that  the 
stability  derivatives  that  have  the  most  effect  on  these  control  force 


and  deflection  gradients  are  and  the  rate  of  change  of  pitching 

moment  with  elevator  deflection.  Since  CM(j  has  been  determined  from 
short  period  results,  the  static  longitudinal  stability  test  results  can 
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be  matched  between  simulator  and  airplane  by  varying  CMgg*  By  also 
recording  angle  of  attack  data  during  the  static  longitudinal  stability 
tests  it  is  possible  to  obtain  a first  cut  at  lift  curve  slope. 

Figure  2 shows  this  angle  of  attack  - airspeed  gradient  from  a test 
point  in  the  2F90  program. 

The  next  test  listed  in  table  I involves  maneuvering  longitudinal 
stability.  The  test  method  is  described  in  detail  in  reference  (3). 

The  objective  Is  to  obtain  the  following  gradients  from  a number  of  trim 
points  throughout  the  flight  envelope: 

1)  longitudinal  control  forces  vs  normal  acceleration. 


2)  longitudinal  control  displacement  vs  normal  acceleration. 


3)  angle  of  attack  vs  normal  acceleration. 


These  gradients  are  all  obtained  at  constant  airspeed.  Figure  3 Is  an 
example  from  the  2F90  program.  From  theoretical  analysis  (reference  (3)) 
It  can  be  shown  that  the  rate  of  change  of  longitudinal  control  force 
and  displacement  with  normal  acceleration  are  a function  primarily  of 
the  stability  derivatives  Cmq^,  Cnfig,  and  CMq,  the  rate  of  change  of 
pitching  moment  with  pitch  rate,  and  bobweight  effects.  Since  Cfict  and 
CM5e  have  been  adjusted  at  a given  trim  point  by  previous  tests,  the  pri- 
mary derivative  to  be  adjusted  to  match  maneuvering  stability  results  is 
The  lift  curve  slope,  Cj^,  can  be  further  refined  by  matching  the 
d^a  collected  In  figure  3. 


In  order  to  obtain  a good  match  of  longitudinal  flying  qualities 
between  simulator  and  airplane  the  entire  sequence  of  tests  listed  In 
table  1 must  be  Iterated  a number  of  times  and  of  course  all  tests  must 
be  performed  throughout  the  flight  envelope  of  the  airplane. 

The  next  test  Is  a determination  and  match  of  aircraft  stall  and 
post  stall  characteristics.  In  tactical  fighter  and  attack  aircraft  an 
accurate  simulation  of  this  area  of  flight  Is  extremely  desirable.  Since 
this  area  cannot  be  modeled  by  linear  equations  of  motion  to  any  satis- 
factory degree  and  since  nonlinear  programming  is  costly  In  terms  of 
both  computation  time  and  memory  requirements,  the  degree  of  simulation 
required  In  this  area  Is  a critical  decision  early  In  the  design  stages 
of  the  simulator.  We  have  found  that  with  a minimum  of  effort  and 
expense  It  Is  possible  to  provide  acceptable  stall  characteristics  with 
a moderate  number  of  logic  routines  and  adjustments  .to  aerodynamic 
coefficients  In  the  linearized  equations  of  motion  at  high  angles  of 
attack.  For  example.  In  the  2F90  program  a logic  routine  was  added  to 
simulate  wing  rock  and  consisted  of  a sinusoidal  roll  function  with 
amplitude  Increasing  with  Increasing  angle  of  attack  commencing  at  19 
units.  In  addition,  CMbASIC  Increased  at  stall  angles  of  attack 
effectively  decreasing  elevator  control  which  provided  an  oscillating 
motion  in  pitch  above  stall  that  was  very  representative  of  the  air- 
plane. 


9 


I 


1 


t 


I 


TM  75-1  SA 


Other  miscellaneous  longitudinal  flying  qualities  tests  Include 
investigations  of  phugold  frequency  and  damping,  takeoff  and  landing 
characteristics  (ground  effects),  transonic  effects,  and  so  on. 

Lateral-directional  flying  qualities  tests  methods  will  now  be 
considered.  The  tests  used  to  isolate  lateral-directional  flying  quali- 
ties fidelity  deficiencies  are  given  in  table  II.  The  first  step  is  to 
perform  static  tests  on  the  mechanical  characteristics  of  the  lateral 
(aileron)  and  directional  (rudder)  control  system.  As  with  the  longi- 
tudinal controls,  breakout  forces,  deadbands,  static  forces  versus  de- 
flection, full  throw  forces  and  deflections,  control  centering  charac- 
teristics, friction  levels,  freeplay,  viscous  effects,  trim  rates,  etc. 
are  measured  and  matched  between  simulator  and  airplane. 

Next,  lateral  control  effectiveness  is  evaluated  with  lateral 
control  rolls  performed  throughout  the  flight  envelope.  The  most  effec- 
tive test  technique  found  was  to  observe  the  roll  and  yaw  response  of 
the  airplane  and  simulator  to  a lateral  control  step  input  performed  by 
the  pilot.  In  tactical  aircraft  with  high  roll  rates  it  is  desirable  to 
restrict  the  step  size  to  reduce  roll  rates  to  within  accurately  measurable 
limits.  On  the  2F90  program  a stick  restriction  jig  was  used  to  limit 
lateral  stick  displacement  to  one  inch  (2.54  cm.)  while  performing  these 
tests.  Bank  angle  time  histories  were  then  generated  by  recording  times 
to  given  changes  in  bank  angle.  Representative  results  from  the  2F90 
program  are  given  in  figure  4.  The  Important  stability  derivatives 

power,  and  C£p,  roll  damping,  have  the  most  pronounced 
effects  on  the  results  of  these  tests  and  can  be  used  to  match  simulator 
and  airplane  roll  rates.  Before  modification  the  2F90  device  exhibited 
extremely  slow  roll  response  for  all  one  inch  stick  deflection  tests  as 
shown  in  figure  4.  For  example,  in  the  simulator  time  to  roll  180°  at 
250  kt  in  conf i^guratlon  CR  was  14.8  sec  vice  2.4  sec  for  the  airplane. 
However,  roll  response  to  full  stick  Inputs  closely  matched  published 
flight  test  data.  The  slow  roll  response  of  the  simulator  was  attributed 
to  a software  routine  that  modified  the  true  commanded  aileron  deflection 
by  the  relation: 


6 


af 


(2) 


where  6^  is  true  aileron  deflection  and  63^  is  the  modified  aileron 
deflection  applied  to  the  roll  moment  equation.  The  value  40  represents 
full  aileron  deflection  (total  differential  between  left  and  right  sur- 
faces) in  degrees.  This  relation  had  been  installed  by  the  simulator 
manufacturer  in  response  to  fleet  user  complaints  that  Device  2F90  was 
too  sensitive  laterally.  Prior  to  NATO  involvement,  another  effort  had 
been  made  to  make  Device  2F90  lateral  response  more  realistic  when  using 
the  visual  display.  The  6af  relation  was  removed  and  a small  dead  zone 
around  neutral  stick  deflection  was  installed  in  the  software  routine 
that  calculated  true  aileron  deflection  as  a function  of  lateral  stick 
deflection.  This  modification  caused  severe  lateral  PIO  problems  in  the 
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simulator  that  were  uncharacteristic  of  the  airplane  especially  during 
high  gain,  closed  loop  tasks  such  as  maintaining  lineup  during  field  and 
carrier  approaches  when  using  the  visual  display. 

In  order  to  match  simulator  response  to  the  airplane  the  63^ 
relation  and  the  deadzone  were  discarded.  Adjustments  were  made  to  the 
values  of  aileron  effectiveness,  and  roll  damping,  C£p,  until  a 

proper  match  was  obtained  by  quantitative  and  qualitative  analysis. 

Qualitative  analysis  through  such  tasks  as  turn  reversals.  Instrument 
patterns,  and  approaches  (using  the  visual  display)  was  used  to  guide 
the  adjustment  process. 

The  next  tests  to  be  performed  are  the  dynamic  lateral-directional  ’ 

stability  tests;  specifically  the  determination  of  the  Dutch  roll  mode  i 

frequency  and  damping.  From  these  tests  the  derivatives  Cnr,  the  rate 
of  change  of  yawing  moment  with  sideslip,  and  the  yaw  damping 

derivative  can  be  determined  (reference  (3)). 

Steady  heading  sideslip  tests  (reference  (3))  can  then  be  used  to 
determine  rudder  power,  C£g,  dihedral  effect,  and  Cyg,  the  side 

force  derivative. 

Testing  Peripheral  Equipment  for  Flight  Fidelity 

After  all  major  flying  qualities  and  performance  discrepancies  are 
eliminated  In  the  fixed  base  simulation,  the  motion  base  Is  added  and 
evaluated.  Items  to  be  evaluated  include  acceleration  cues  In  al'l 
degrees  of  freedom  simulated,  aerodynamic  stall  buffet  and  transonic 
buffet  simulation. 

Again  the  experience  gained  on  the  2F90  program  Is  instructive. 

The  buffet  provided  to  simulate  aerodynamic  stall  through  the  motion 
system  was  unsatisfactory  In  three  respects.  First,  the  buffet  was  ini- 
tiated at  20  units  AOA  regardless  of  the  type  stall  encountered.  In 
essence,  accelerated  stall  buffet,  which  Is  a function  of  Mach  number 
and  angle  of  attack  was  not  simulated.  This  was  considered  a major 
discrepancy  since  buffet  onset  Is  used  by  the  pilot  in  most  aerobatic 
and  mission  related  visual  maneuvers  to  gain  optimum  performance  from 
the  airplane.  Second,  the  amplitude  of  the  buffet  at  onset  was  high, 
simulating  the  heavy  buffet  associated  with  deep  stall.  In  the  airplane, 
buffet  at  onset  Is  light  In  maneuvering  flight  and  Increases  In  amplitude 
with  Increasing  angle  of  attack.  Third,  the  frequency  of  the  buffet  was 
low  (10  Hertz)  and  constant;  again  typical  of  deep  stall  buffet.  The 
light  buffet  eurountered  in  the  airplane  In  maneuvering  flight  is  of 
much  higher  frequency.  In  summary,  Ig  stall  buffet  was  well  simulated 
whereas  accelerated  stall  buffet  was  not  simulated.  Data  on  buffet 
onset,  amplitude  and  frequency  were  obtained  from  the  airplane.  Using 
these  data  as  a basis,  a function  was  added  to  the  software  to  provide 
buffet  onset  as  a function  of  angle  of  attack  and  Mach  number.  A second 
function  was  added  to  the  software  to  provide  a different  variable 
buffet  amplitude  routine  as  a function  of  angle  of  attack  after  onset 
for  the  accelerated  stall  case.  The  final  problem  was  buffet  frequency. 
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Frequency  limitations  of  the  hydraulic  motion  system  precluded  Increasing 
the  frequency  of  the  buffet  to  simulate  the  high  frequency  light  buffet 
encountered  In  accelerated  stalls.  Thus  no  change  was  made  to  buffet 
frequency. 

The  next  stage  In  the  flight  fidelity  improvement  program  Is  to  add 
the  visual  display  to  the  basic  simulator  In  the  fixed  base  mode  of 
operation  if  provided.  In  the  2F90  device  the  addition  of  the  visual 
display  system  allows  pilot  training  to  be  conducted  in  VFR  flight. 

Closed  loop  VFR  flying  tasks  made  possible  by  the  addition  of  the  visual 
display  Include  field  landings  and  takeoffs,  carrier  landings  and  takeoffs, 
scored  bombing,  formation  flight,  aerobatics,  and  familiarization  flying. 
The  Computer  Generated  Image  (CGI)  display  was  not  evaluated  per  se. 

The  purpose  of  the  flight  fidelity  Improvement  effort  was  to  improve  the 
flight  dynamics  of  the  simulator  so  that  the  simulator  with  the  visual 
display  added  could  be  used  for  VFR  training.  The  visual  display  on  the 
2F90  device  was  evaluated  qualitatively  by  a test  pilot  using  closed 
loop  mission  tasks  to  compare  airplane  and  simulator  performance  and 
flying  qualities.  Many  refinements  to  the  various  stability  derivatives 
and  parameters  in  the  mathematical  model  were  made  as  a result  of  these 
tests.  In  particular  the  ram  drag  trim  addition  referred  to  previously 
in  the  performance  section  of  this  paper  originated  during  closed  loop 
evaluations  of  the  visual  display  in  the  landing  mission. 

Fidelity  Improvement  Program 

A flight  fidelity  improvanent  program  is  best  conducted  in  stages 
as  indicated  in  table  III.  First,  one  must  collect  baseline  data  in  the 
airplane.  It  is  important  to  use  more  than  one  airplane  to  gather  this 
data.  Differences  between  airplanes  are  sometimes  significant.  The 
tests  are  repeated  in  the  simulator.  Data  reduction  and  the  formulation 
of  a plan  of  action  for  fidelity  improvement  follows.  One  then  starts 
the  iterative  reprogramming  process. 

An  important  aspect  of  the  flight  fidelity  improvement  programs  we 
have  conducted  was  the  continuous  refamiliarlzatlon  required  by  the 
pilots  in  the  airplane.  It  is  estimated  that  eight  hours  of  simulator 
time  is  sufficient  to  destroy  a pilot's  familiarity  with  the  airplane  to 
the  point  that  he  can  no  longer  make  valid  qualitative  judgements  on 
flying  qualities  during  closed  loop  tests.  Table  IV  presents  a summary 
of  the  actual  flight  time  flown  by  test  pilots  in  support  of  the  various 
fidelity  improvement  programs  embarked  upon  by  NATC. 

ADVANCED  TEST  METHODS 

The  application  of  conventional  test  methods  to  simulator  fidelity 
improvement  have  been  considered  above.  Let  us  now  address  advanced 
methods.  Specifically,  the  application  of  digital  parameter  identifi- 
cation methods  to  obtain  the  coefficients  and  stability  derivatives  from 
flight  test  data  will  be  discussed.  As  was  mentioned  before,  this  is  not 
an  easy  task.  All  the  services,  the  National  Aeronautics  and  Space  Ad- 
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ministration,  and  Industry  have  done  a great  deal  of  research  In  this  area. 
The  effort  at  the  Naval  Air  Test  Center  is  combined  with  Systems  Control, 
Incorporated  (SCI)  at  Palo  Alto,  California,  and  the  Office  of  Naval 
Research.  SCI  has  delivered  a very  powerful  advanced  algorithm  recently 
which  is  being  used  in  a number  of  programs  at  this  time.  The  algorithm 
employs  a maximum  likelihood  estimation  scheme  to  extract  stability 
derivatives  from  flight  test  data  in  the  presence  of  measurement  noise 
as  well  as  process  noise.  The  theory  and  program  are  presented  in  detail 
in  references  (4)  and  (5)  along  with  flight  test  results  obtained  to 
date. 


Basically  the  program  can  be  described  by  figure  5.  An  appropriately 
instrumented  airplane  is  given  a control  input.  The  airplane  responds. 
That  response  is  contaminated  by  Instrument  noise  and  process  noise.  A 
mathematical  model  of  the  aircraft,  using  the  equations  of  motion  and  an 
initial  guess  for  the  aircraft  coefficients,  is  given  the  same  input. 

The  model  response  is  compared  to  the  contaminated  aircraft  response  and 
a response  error  is  generated.  A criterion  function  is  formed  (response 
error  squared  is  a good  one)  and  this  criterion  function  is  minimized  by 
an  optimization  algorithm;  in  this  case  a maximum  likelihood  estimator. 

The  lower  loop  in  the  figure  is  Iterated  until  a "best"  estimate  of  air- 
craft parameters  is  obtained.  The  algorithm  also  generates  the  statistics 
of  both  the  measurement  and  process  noise.  The  advantage  of  this  program 
for  simulator  applications  is  that  we  are  able  to  obtain  the  aircraft 
coefficients  throughout  the  flight  envelope  very  accurately  and  extremely 
fast.  Basic  SCIDNT  options  are  presented  in  reference  (4)  and  are  shown 
in  table  V. 

This  program  Is  now  operational  at  NATC  and  has  significantly 
Increased  our  capability  to  analyze  flight  data  to  obtain  stability 
derivatives  for  use  in  a mathematical  model  in  a simulator.  The  algorithm 
has  been  used  successfully  on  several  flight  test  programs  but  has  not  as 
yet  been  used  specifically  on  a simulator  flight  fidelity  improvement 
program. 


CONCLUSIONS 

In  this  paper  the  application  of  conventional  fight  test  techniques 
to  the  improvement  of  the  flight  fidelity  of  operational  flight  and 
weapon  system  trainers  has  been  discussed.  Examples  from  flight  fidelity 
Improvement  programs  conducted  on  a number  of  devices  has  been  presented. 

In  these  programs  it  was  discovered  that  the  primary  culprit  in  flight 
fidelity  was  Inadequate  and  Incorrect  computer  software  programming 
caused  by  the  inadequacy  of  the  data  base  used  to  formulate  the  software 
package.  The  application  of  the  conventional  test  methods  discussed 
herein  features  the  use  of  actual  flight  data  to  tailor  simulator  responses 
by  incorporation  software  fixes  in  the  device.  Fidelity  improvement 
programs  using  these  techniques  have  been  successful. 

The  application  of  advanced  test  methods  has  also  been  discussed. 
Recent  advances  in  the  practical  applications  of  control  and  estimation 
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theory  have  made  It  possible  to  extract  stability  derivatives  and  other 
parameters  from  flight  test  data  to  a degree  and  with  accuracy  not 
possible  in  the  past. 

It  is  generally  agreed  that  the  training  obtainable  from  a simulator 
depends  to  a great  extent  on  the  state  of  mind  of  the  trainee;  specifically, 
his  opinions  of  the  fidelity  of  the  simulation.  Obviously,  ve  cannot 
give  him  everything.  Simulators  cost  a lot  of  money.  What  we  can  do  is 
give  him  the  best  simulation  possible  within  the  limits  of  the  hardware 
we  can  afford  to  buy.  Software  optimization  takes  time,  team  work,  and 
commitment.  The  results  are  well  worth  the  effort. 
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PRIMARY  TEST  SEQUENCE  FOR  LOITCITUDINAL  PARAMETERS 
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6.  Steady  State  Trim  Airspeed,  Gross  Weight  due  to  flaps 

Points  (Power  Approach  

Configuration  at  On-speed  Longitudinal  Trim  ^TRTM  (higher  a range) 

Angle  of  Attack) 
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TABLE  III 

STAGES  IN  SIMULATOR  CORRECTION  PROCESS 


ITEM 

TASK 

1. 

Collect  Baseline  Data 

2. 

Repeat  Tests  in  Simulator 

3. 

Reduce  Data  and  Formulate  Plan 

4. 

Reprogram  Simulator 

5. 

Add  Peripheral  Equipment 

6. 

Evaluate  Total  System 

TABLE  IV 

AIRCRAFT  FLIGHT  TIME  REQUIRED 


OFT/WST 

FLIGHT  HOURS 

NUMBER  OF  AIRCRAFT 
UTILIZED 

2F101  (T-2C) 

63.3 

7 

2F90  (TA-4J) 

26.3 

11 

2F103  {A-7E  NCLT) 

15.1 

7 

2F108  (A-4M) 

30.0 

2 

2F107  (KC-13b) 

8.0 

2 
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TABLE  V 

SCIDNT  CAPABILITIES  AND  OPTIONS 


NUMBER 


DESCRIPTION 


Any  parameter  may  be  fixed  or  contralned  to  be 
within  certain  bounds. 


A Priori  weighting  may  be  placed  on  parameter 
estimates . 

Standard  deviations  of  parameter  estimation 
errors  are  computed. 

Biases  and  random  noise  errors  in  instruments 
are  computed. 

Process  noise  may  be  Included  and  its  magni- 
tude and  break  frequency  identified. 

Process  noise  effects  may  be  Included  but  not 
identified. 

Measurements  from  failed  Instruments  may  be 
deleted. 


States  may  be  deleted  which  do  not  signifi- 
cantly enter  the  aircraft  modes  of  the 
particular  data  record  considered. 

Rank  deficient  solution  may  be  used  to  compute 
the  Inverse  of  the  information  matrix. 


Longitudinal 


LONGTUDINAL  CONTROL  CYCLE 
Longitudinal  Trim:  0° 
Speedbrakes IN 
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Altitude  - 5,000 
Fuel  Weight  - 3,600  lb 
O TA-4J  BuNo  158075 
A Device  2F90  Before  Modification 
A Device  2F90  After  Modification 


LONGITUDINAL 

LONGITUDINAL  STICK  DISPLACEMENT 

ANGLE  OF  ATTACK  STICK  FORCE  FROM  TRIM 

UNITS  LB-PULL  IN-AFT 
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Altitude  - 15,000  ft 
Airspeed  - 350  kt 
Fuel  Weight  - 6000  lb 
O TA-4J  BuNo  158087 
A Device  2F90  Before  Modification 
A Device  2F90  After  Modification 
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MANEUVERING  LONGITUDINAL  STABILITY  CHARACTERISTICS 

Configuration  CR 
15,000  Feet 
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Altltad«  - 15,000  ft 
C TA-4J  BuMo  1S5100 
O TA-4J  BuNo  158075 


4 D«vlc«  3P90  B«for*  NodiflCAtion 
4 0«vic«  2P90  Aft«r  Modific«tlon 

AIKSPCEO:  290  KT 


TIME  - SEC 


LATERAL  CONTROL  EFFECTIVENESS 
One  Inch  Lateral  Stick  Deflection 
Configuration  CR 
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Distribution: 
C(»1NAVA1RTESTCEN  CT02 

(1) 

COMNAVAIRTESTCEN  CT03 

(1) 

COMNAVAIRTESTCEN  CTOS 

(1) 

SATD  SAOl 

(1) 

SAID  SA02 

(1) 

SATD  SA04 

(1) 

SATD  SA41 

(200) 

SATD  SA60 

(1) 

SETD 

(1) 

RWTD 

(1) 

ATTD 

(1) 

CSD 

(1) 

TSD 

(1) 

TPS 

(1) 
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